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Toolbox for acoustic scene creation and rendering 


a New toolbox: TASCAR 

Toolbox for Acoustic Scene Creation And Rendering 
a Open source (GPL/LGPL), http://linuxaudio.vegri.net/ 
a Inspired by existing tools: 

a SoundScapeRenderer (jack, TU Berlin) 
a AMB plugins (ladspa, Fons & Jorn) 

a Focus: Dynamic spatial content creation 
a Initially developed for music performance 
a Extended within research project 
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Research targets 


a Spatial psychoacoustics, e.g. 

a Precedence effect of moving sources 
a Localization, Source tracking 

a Speech perception, e.g. 

a Speech intelligibility in complex scenes 
a Effect of head- and torso movements 

a Hearing aids, e.g. 

a Directional microphone algorithm evaluation 
a Gesture recognition for hearing aid control 
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What we would like to have: 


a Realistic acoustic scenes with high spatial complexity 
(e.g., 'cafeteria problem', public transort) 

9 Physically correct sound field within a certain sweetspot 
(human and machine listening) 

9 Spatial dynamics of sources are controllable 
9 Contents exchangable independently from spatial 
configuration 
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Acoustic scene creation and rendering 


a Create tracks (csv format: t, x, y, z): Record sound and 
GPS track, project to local coordinates 
— y tascar_gpx2csv 

a Play position as jack ports, use jack transport 
—>• tascar_jpos 

a Panning module takes position and audio as jack ports 
a Render to speaker given layout in several formats 

(nearest, vbap, amb_basic, amb_inphase, wfs, cardiod) 
—y tascar_multipan 

a Add ambient background noise (first order ambisonics), 
use ambdec for rendering to speaker layout 
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Example scene: Outdoor (street) situation 
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Harmony of the Spheres - concert 


NtloJua mcfod* Q hypadot. proiU.ttna. 


Caucus, Altus. 


Tenor. 
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Harmony of the Spheres - concert 


NtloJm mcfod* Q hypadot. proiU.ttna. 


Camus, Altas. Tenor. 


Ballus. 


® Harmony of the Spheres: Philosophical concept of 
projecting celestial relationships (renaissance) 
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Harmony of the Spheres - concert 


NtloJm mcfod* Q hypadot. proiU.ttna. 


Camus, Altas. Tenor. 


Ballus. 


a Harmony of the Spheres: Philosophical concept of 
projecting celestial relationships (renaissance) 

a Music theory devised from celestial motions 
(e.g., Bartolus 1614, Kepler 1619, Kircher 1650) 
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Nttochu rntfcii" Q hyfadoi. prosli.Uria. 

** Cautus; Altas. Tenor. Balias. 

a Harmony of the Spheres: Philosophical concept of 
projecting celestial relationships (renaissance) 

a Music theory devised from celestial motions 
(e.g., Bartolus 1614, Kepler 1619, Kircher 1650) 

a Number aesthetics and symmetry affected compositions 
(musical form, number of voices, rules of algorithmic 
composition) 
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Harmony of the Spheres - concert 


Nttochu rntfcii" Q hyfadoi. prosli.Uria. 

** Cautus; Altas. Tenor. Balias. 

a Harmony of the Spheres: Philosophical concept of 
projecting celestial relationships (renaissance) 

a Music theory devised from celestial motions 
(e.g., Bartolus 1614, Kepler 1619, Kircher 1650) 

a Number aesthetics and symmetry affected compositions 
(musical form, number of voices, rules of algorithmic 
composition) 

a Subtle deviation from regularities create musical content 
in minimal music 
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a Create virtual sources from acoustic inputs 
a Let them move around the audience 
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o Mr. Picforth: In Nomine (16. century) 

Perfect proportion, voices representing planets 

® John Cage: Five (1988) 

Transition from disorder to harmony and back to disorder 
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- spatialization 


o Mr. Picforth: In Nomine (16. century) 

Perfect proportion, voices representing planets 

® John Cage: Five (1988) 

Transition from disorder to harmony and back to disorder 

9 Lee Santana: Music for Viols (1988) 

Late minimal music, ’choreography’ amplifies composer’s 
intentions 
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Harmony of the Spheres 

- spatialization 


o Mr. Picforth: In Nomine (16. century) 

Perfect proportion, voices representing planets 

® John Cage: Five (1988) 

Transition from disorder to harmony and back to disorder 

9 Lee Santana: Music for Viols (1988) 

Late minimal music, ’choreography’ amplifies composer’s 
intentions 

Christopher Tye (c. 1505-1572), Giovanni Pierluigi Palestrina 
(1525-1594), Nicholas Strogers (f 1575), Arvo Part (*1935), 
Steve Reich (*1936) 
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Harmony of the Spheres - signal flow 
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Harmony of the Spheres - signal flow 
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Concert setup 


hos_sphere: Trajectory generator 



® Superposition of Kepler ellipse 
and epicycle 
9 Ellipse 

a p nominal radius 
a e eccentricity 
a 6 main axis rotation 
a co nominal angular velocity 
9 Epicycle 

a p epi radius 
a u epi angular velocity 
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Concert setup 


hos_sphere: Distance coding 


® Stereo reverberation 

convolution reverb 'chapel' from 
Fons Adriaensen 

® Virtual stereo source around 
source direction 
® Distance r affects 

a amount g of reverberation 
g( r ) = I T? 

a width w of stereo source 
W ( c) — W max r 2_|_2 
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Concert setup 


Control interfaces and parameter selection 
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Parameter selection with real footswitch 


a MIDI foot switch (FCB1010) 
connected to ’mididings’ 

9 Invoke shell script on program change events 
9 Read preset files, send as OSC messages to ’hos_sphere’ 
9 Control ardour transport with OSC messages 


- z 31010 

IIBliB 

1 

111111 
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Parameter selection with virtual footswitch 


o Viola da 
gamba is held 
between the 
legs 
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Parameter selection with virtual footswitch 


o Viola da 
gamba is held 
between the 
legs 

o Lifting the 
heel is 
difficult 



Giso Grimm & Tobias Herzke — http://orlandoviols.de/ 


Dynamic spatial acoustic scene generation.. . 









Introduction Parametrized cyclic dynamic panning 
Hearing research Control interfaces and parameter selection 

Music performance Monitoring 

Appendix Concert setup 

Parameter selection with virtual footswitch 


o Viola da 
gamba is held 
between the 
legs 

o Lifting the 
heel is 
difficult 

=>■ Optical foot 
scanner 
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Parameter selection with virtual footswitch 



a kinect game controller 3d-camera 
a Track position of foot tip 
a Four states can be detected: 
o empty: no foot present 
o straight: neutral foot position 
o right: increase program number 
» left: decrease program number 

a Shell scripts executed on program change 



difference 
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Monitoring 




_WL. 

transport 


jgain.pan 
i (midi) 


virtual 

footswitch 
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transport 

(midi) 


gain 
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kinect 


Giso Grimm & Tobias Herzke — http://orlandoviols.de/ 


Dynamic spatial acoustic scene generation.. . 







































Introduction 
Hearing research 
Music performance 
Appendix 

Parametrized cyclic dynamic panning 

Control interfaces and parameter selection 

Monitoring 

Concert setup 

Monitoring: 1 

Requirements 


a Concert setup with huge distances between musicians 
—> 'Zero latency’ in-ear monitoring is necessary 

9 Only dry sound monitor 

9 Pre-recorded announcements 
(program change, time, count in) 

9 Spatial cues by interaural level differences 
9 Real-time modifications during sound check & concert 
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Monitoring: Hard- and software 


a RME hdsp9652 matrix mixer 

» ’hdspmixer' is missing hardware interface and grouping 
features 

=» own software 
a OSC based network solution: 

a 'mm_hdsp': access to hardware mixer 
a 'mm_midicc': interface to MIDI controller (BCF2000) 
» 'mm_file': load, save and manipulate mixer matrix 
a 'mm_gui': visualize gain matrix 
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Monitoring: Hard- and software 


» sub-set of gain matrix 
—>• no conflict with other 
mixing software 

® Assign names to inputs 
and outputs 

9 Routes can be 
multi-channel 
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Demonstration video 


today 4:45pm —> listening room 
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Thank you and all other LADs! 


Supported by 

9 German research funding organization DFG, Research Unit 1732 
“Individualisierte Horakustik” 

9 "klangpol — Neue Musik im Nordwesten” (Contemporary Music in north-west 
Germany). 
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’tascar_gpx2csv’ 


a Tangent projection of GPS coordinates to local 
coordinates 

a Smoothing and resampling to correct errors and jitter 
a Time shift to match jack transport time 
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’tascar_multipan’ 


a Multiple panning methods & render, switchable via OSC 
messages over UDP multicast (/*/mode): 

» Nearest speaker (nearest) 
o Vector based amplitude panning (vbap) 

9 Higher Order Ambisonics (amb_basic, amb_inphase) 

9 Wave field synthesis (wfs) 

9 Cardioid microphone array, e.g. ORTF (cardiod) 

9 Direct HOA output planned 

9 Speaker/microphone configuration in XML 
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’tascar_multipan’ 


a Multiple panning methods & render, switchable via OSC 
messages over UDP multicast (/*/mode): 

» Nearest speaker (nearest) 
o Vector based amplitude panning (vbap) 

9 Higher Order Ambisonics (amb_basic, amb_inphase) 

9 Wave field synthesis (wfs) 

9 Cardioid microphone array, e.g. ORTF (cardiod) 

9 Direct HOA output planned 

9 Speaker/microphone configuration in XML 
9 Distance coding with delay and gain simulation 
=»■ Doppler effect 

9 Delay- and gain compensation of speaker distances 
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hos_sphere: Trajectory generator 


Kepler ellipse with epicycle component: 


PeW) 

1 — ecos(p — 6) 

{}Pi Pepi) 

= Pee itp + pe P ie i<Pepi 

A p 

cop 2 

o 


Pt 

Pepi 

— epi 


Also: Random component, <p proportional to signal envelope 
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Parameter selection with virtual footswitch 


a Training phase (before concert) 

a Calculating depth difference to 'empty' state 
» Find clusters with depth differences between states 



□ ► < g > <!► < 1 ► 1 'OQ.O 
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Parameter selection with virtual footswitch 


a Training phase (before concert) 

a Calculating depth difference to 'empty' state 
» Find clusters with depth differences between states 
a Test phase (during concert) 

a Calculate error difference to training data 
9 Select state with least error 

o State change: left/right detected during 0.25 seconds 
9 Predefined shell command is evoked on program change 
9 Shell commands trigger OSC messages 

< s ► <!► <!► 1 -O Q.O 
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